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Abstract 

Necessary  and  sufficient  conditions  are  established  for  cumulative  processes  (associated  with 
regenerative  processes)  to  obey  several  classical  limit  theorems;  e.g.,  a  strong  law  of  large 
numbers,  a  law  of  the  iterated  logarithm  and  a  functional  central  limit  theorem.  The  key  random 
variables  are  the  integral  of  the  regenerative  process  over  one  cycle  and  the  supremum  of  the 
absolute  value  of  this  integral  over  all  possible  initial  segments  of  a  cycle.  The  tail  behavior  of 
the  distribution  of  the  second  random  variable  determines  whether  the  cumulative  process  obeys 
the  same  limit  theorem  as  the  partial  sums  of  the  cycle  integrals.  Interesting  open  problems  are 
the  necessary  conditions  for  the  weak  law  of  large  numbers  and  the  ordinary  central  limit 
theorem.  (■  - ' 
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1.  Introduction 


In  this  paper  we  establish  necessary  and  sufficient  (N&S)  conditions  for  several  limits  to  hold 
for  appropriately  normalized  cumulative  processes  (associated  with  regenerative  processes),  with 
the  emphasis  being  on  the  necessity.  The  limits  we  have  in  mind  are  the  limits  in  the  strong  taw 
of  large  numbers  (SLLN),  the  law  of  the  iterated  logarithm  (LIL),  the  weak  law  of  large  numbers 
(WLLN),  the  central  limit  theorem  (CLT)  and  functional  generalizations  of  these,  denoted  by 
FSLLN  and  so  forth;  we  define  the  versions  we  consider  precisely  in  §2.  The  topic  of  this  paper 
is  very  close  to  classic  results,  e.g.,  see  Gnedenko  and  Kolmogorov  (1968).  Hence,  there  is 
considerable  related  literature.  In  particular,  our  paper  extends  Smith  (1955),  Chung  (1967), 
Iglehart  (1971),  Brown  and  Ross  (1972),  Serfozo  (1972,  1975),  Whitt  (1972),  Glynn  and  Whitt 
(1987,  1988a, b)  and  Asmussen  (1987). 


We  use  the  “classical”  definition  of  regenerative  process  throughout:  i.e.,  the  process  splits 
into  i.i.d.  cycles;  cf.  p.  125  of  Asmussen  (1987).  For  the  necessity  results,  this  is  without  loss  of 
generality.  Let  0  <  7(0)  <  7(1)  <  ...  denote  the  regeneration  times,  with  7(-  1)  =  0. 
Consider  a  stochastic  process  {X(r)  :  r>0)  with  general  state  space  and  a  measurable  real¬ 
valued  function /.  We  assume  that  the  process  { X(r)  :  f  >  0 }  is  regenerative  with  respect  to  these 
regeneration  times,  and  we  focus  on  the  associated  cumulative  process  Cs  {C(f)  :  r>0}, 
defined  by 


C(0  =  /J/(X(s))dj  .  r>0  . 
The  key  random  variables  associated  with  the  cycles  are 
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By  “regenerative  structure,”  we  mean  that  for  any  suitable  /  the  three-tuples 
(X,.  y,U)<  are  i.i.d.  for  /  >  1.  We  also  assume  throughout  that  £Xi  <  <».  In  addition, 

we  assume  throughout  that 

l/(X(s))lds  <  CO  w.p.  1  for  each  / ,  (1.3) 

which  implies  that  the  cumulative  process  C  has  continuous  sample  paths  w.p.l. 

We  shall  consider  the  given  function  /  and  a  centered  function  defined  by 
/c(J^)  =  /(^)  -  ot  for  a  constant  a,  both  of  which  are  assumed  to  satisfy  (1.3).  When  we  write 
Ki  or  Wj  we  understand  the  function  /to  be  the  given  one. 

We  are  interested  in  N&S  conditions  for  the  cumulative  process  to  obey  the  classical  limit 
theorems.  For  this  purpose,  it  is  natural  to  represent  the  cumulative  process  as  a  random  sum  of 
i.i.d.  summands  plus  two  remainder  terms.  In  particular, 

C(0  m  j^'/(X(s))ds  =  +  Riit)  +  R.JO  .  ^^0,  (1.4) 

where 

S„  =  y,  +...+ .  n>  1  ,  (1.5) 

with  So  =  0,  N  *  {N(t)  :  i  >  0}  is  the  (possibly  delayed)  renewal  counting  process  associated 
with  the  regeneration  times,  i.e., 

/V(i)  =  max{i ;  r(i)  , /^O  ,  (1.6) 

and  R,  s  {/?,  (/)  ;  r  ^  0 }  are  the  remainder  processes,  defined  by 

/?,(/)  =  and  RziO  =  j'  /(X(s))ds  ,  t  >  0  .  (1.7) 

Since  £Ti  <  oo,  we  have 


\  m  l/£X|  as  r  -»  oo  w.p.l  , 


(1.8) 


which  we  will  exploit  frequently.  Since  |/?i(0|  ^  W'o-  we  see  that  the  first  remainder  term 
/?](/)  in  (1.7)  is  trivially  dispensed  with  in  limit  theorems  since  it  is  bounded  by  a  random 
variable  that  does  not  depend  on  t.  A  significant  part  of  the  analysis  is  finding  what  knocks  out 
the  second  remainder  term  /?2  (/)  in  (1.7).  Of  course,  the  key  relation  here  is 

|/?:(r)|  <  Wyvo)  .  t>0  .  (1.9) 

From  (1.9)  it  is  evident  that  we  could  just  as  well  impose  conditions  on  the  supremum  over  the 
integral  from  s  to  the  end  of  the  cycle  instead  of  on  (This  is  to  be  expected  since  our 

definition  of  regenerative  process  is  time  reversible.) 

Given  (1.4),  it  is  interesting  to  compare  N&S  conditions  for  limit  theorems  for  the  cumulative 
process  C(t)  with  N&S  conditions  in  the  corresponding  limit  theorem  for  the  random  sums  Syv(j)- 
In  turn  it  is  interesting  to  compare  the  N&S  conditions  in  the  limit  theorems  for  the  random  sums 
S/vd)  with  the  N&S  conditions  in  the  corresponding  limit  theorem  for  the  ordinary  partial  sums 
5„  in  ( 1 .5).  We  state  our  main  result  in  §3  so  as  to  make  these  connections  clear. 

Here  is  how  the  rest  of  the  paper  is  organized.  In  §2  we  specify  precisely  what  we  mean  by 
the  classical  limit  theorems.  (It  is  important  to  note  that  there  are  several  possible  definitions.) 
After  we  state  the  main  results  in  §3,  we  establish  some  supporting  propositions  in  §4.  We 
establish  N&S  conditions  for  the  WLLN  and  a  joint  CLT  for  C  and  A(  in  the  case  /is  nonnegative 
in  §5.  We  then  prove  the  main  result  in  §6. 

2.  The  Classical  Limit  Theorems 

In  this  section  we  indicate  precisely  what  we  mean  by  the  classical  limit  theorems.  For  this 
purpose,  consider  a  general  stochastic  process  Z  ■  {Z(f)  :  t  >  0}  with  real-valued  sample  paths 
having  limits  from  the  left  and  right.  (Note  that  we  consider  only  one  process  rather  than  a 
sequence  of  processes.)  By  (1.3),  the  cumulative  process  C  actually  has  continuous  sample  paths. 
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but  the  random  sums  Suit)  and  the  partial  sums  S„  do  not.  Discrete-time  processes  can  be 

* 

regarded  as  the  special  case  in  which  Z(f)  =  Z((r]).  where  [r]  is  the  greatest  integer  less  than  or 
equal  to  /. 

We  say  that  Z  obeys  a  SLLN  if  there  exists  a  constant  a  such  that  t"  *  Z(t)  — ^  a  as  t  — »  <» 
w.p.  1 .  We  say  that  Z  obeys  a  FSLLN  if  there  exists  a  constant  a  such  that,  for  each  T  with 
0  <  T  <  oo, 

sup  |n"*Z(n/)  -  a/|  — »  0  as  «  — >  »  w.p.  1  .  (2.1) 

0  s  rs  r 

As  in  Theorem  4  of  Glynn  and  Whitt  (1988),  such  a  FSLLN  is  actually  equivalent  to  the  ordinary 
SLLN  above,  so  we  do  not  discuss  it  further.  (To  verify  this,  we  use  the  existence  of  left  and 
right  limits  to  conclude  that  sup  |Z(s)|  < »  w.p.l  for  all  r,  e.g.,  see  p.  110  of 

Billingsley  (1968).) 

We  say  that  Z  obeys  an  LIL  if  there  exist  constants  a  and  P  such  that  P  ^  0  and 

[Z(r)  -  ar]/V2rIT7  I-  >/p  .  Vp  ]  w.p.  1  ,  (2.2) 

where  Lx  =  max{  1,  log^x},  Ltx  =  Lt_i(£ac)  and  denotes  that  the  set  on  the  left  is 
relatively  compaa  with  the  set  on  the  right  being  the  set  of  all  limit  points  of  convergent 
subsequences  (with  r*  — » <»  as  ik  — >  oo). 

For  the  FLIL  and  FCLT  we  work  in  the  function  space  D[0,  oo)  with  the  usual  Skorohod  (7 1 ) 
topology,  see  Billingsley  (1968),  Whitt  (1980)  and  Ethier  and  Kurtz  (1986).  Following 
Strassen  (1964),  we  say  that  Z  obeys  a  FLIL  if  there  exist  constants  a  and  P  with  p  ^  0  and  a 
compact  set  C  in  D[0,  oo)  such  that 

[Z(n/)  -  ant]/yj2nL2n  v-*  V^C  w.p.l  (2.3) 


where  convergence  of  a  subsequence  is  understood  to  be  in  D[0,  oo)  and  the  limit  set  C  is  the  set 
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of  all  functions  {a:(0  ;  /  >  0}  that  are  absolutely  continuous  with  respect  to  Lebesgue  measure 

with  derivative  x' (t)  satisfying  x'(t)~dt  <  1.  (This  is  the  standard  limit  set  associated  with 
partial  sums  of  i.i.d.  random  variables.) 

We  say  that  Z  obeys  a  WLLN  if  there  exists  a  constant  a  such  that  '  Z(r)  a  as  /  -»  oo, 
where  =>  denotes  convergence  in  law,  which  coincides  with  convergence  in  probability  in  this 
case  because  a  is  deterministic.  We  say  that  Z  obeys  a  FWLLN  if  there  exists  a  constant  a  such 
that 

[Z(nt)  -  anr]/n  =»  0  in  £>[0,  <»)  as  «  — »  »  .  (2.4) 

We  say  that  Z  obeys  a  CLT  if  there  exist  constants  a  and  P  with  P  >  0  such  that 

[Z(/)  -  a^]/^/7  =>  ^/^^(0.1)  as  r oo  ,  (2.5) 

where  N(0,1)  denotes  a  standard  (mean  0.  variance  1)  normal  random  variable.  We  say  that  Z 
obeys  a  FCLT  if  there  exist  constants  a  and  P  with  P  >  0  such  that 

[Z(n/)  -  ant]/Vn  ^  in  D[0,oo)  as  n  oo  ,  (2.6) 

where  fl(r)  is  standard  (drift  0,  diffusion  coefficient  1)  Brownian  motion. 

It  is  significant  that  in  all  the  limit  theorem  above  we  have  stipulated  fixed  normalization 
constants.  We  always  translate  Z(t)  by  at.  In  the  LLN,  LIL  and  CLTs  we  always  divide 
Z(f)  -  at  by  t,  yJltLnt  and  V7,  respectively.  Moreover  in  the  CLT  we  have  specified  that  the 
limit  be  standard  normal.  For  partial  sums  of  i.i.d.  random  variables,  these  assumptions  are 
known  to  significantly  restrict  the  range  of  possibilities;  e.g.,  see  Gnedenko  and 
Kolmogorov  (1968).  For  example,  for  partial  sums  of  i.i.d.  random  variables,  the  CLT  involves 
the  domain  of  normal  attraction  of  the  normal  law,  for  which  the  N&S  condition  is  for  the 
underlying  distribution  to  have  finite  second  moment;  see  p.  181  of  Gnedenko  and 
Kolmogorov  ( 1968). 
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3.  The  Main  Result 

In  this  section  we  state,  wherever  possible,  N&S  conditions  for  the  three  processes  5„, 
and  C{t)  defined  in  (1.1),  and  (1.4)-<1.6)  to  obey  the  seven  limit  theorems;  SLLN,  LIL,  FLIL, 
WLLN,  FWLLN,  CLT  and  FCLT.  (We  have  ir.dicated  that  the  FSLLN  is  equivalent  to  the  SLLN 
in  the  setting  of  §2.) 

To  relate  the  limit  theorems  for  the  partial  sums  to  the  random  sums  and  cumulative 
processes,  we  assume  that  the  summands  Y,  are  of  the  form  Y,{fc)  for  an  appropriate  centering 
constant  a.  When  E\Y\(fc)\  <  <»,  the  parameter  a  will  be  chosen  so  that  E  Y^ifc)  =0. 

We  prove  the  following  in  §6.  More  results  in  the  case /is  nonnegative  appear  in  §5. 

Theorem  3.1.  (a)  For  the  WLLN  and  CLT,  the  N&S  conditions  for  the  random  sums  Sf/(t)  and 
the  cumulative  process  C(t)  are  the  same.  For  all  other  theorems,  the  N&S  conditions  for  the 
partial  sums  S„  and  the  random  sums  S/sf(,)  are  the  same. 

(b)  The  specific  N&S  conditions  for  the  partial  sums  S„  and  the  cumulative  process  C(t)  are 
given  in  Table  1,  with  a  question  mark  indicating  that  the  answer  is  unknown.  Each  established 
N&S  condition  for  the  cumulative  process  is  the  N&S  condition  for  the  partial  sum  plus  the 
indicated  extra  condition. 

(c)  For  the  WLLN  and  CLT,  the  N&S  condition  for  the  partial  sums  S„  is  sufficient  for  the 
random  sums  Sf/(,)  and  the  cumulative  process  C(t).  Moreover,  these  conditions  are  necessary 
in  the  sense  that  there  are  examples  for  which  the  random  sum  and  cumulative  process  limits  do 
not  exist  when  these  conditions  are  violated  (See  Remark  3.2  below.) 

(d)  For  the  WLLN  and  the  FWLLN,  the  centering  constant  a  is  necessarily  the  limit  of 
£[  T 1 ;  1  T 1 1  ^  / 1  os  r  — »  oo.  In  all  other  cases  it  is  necessarily  EY  | ,  which  is  consequently  finite. 


(e)  The  normalizing  constant  P  in  the  UL  FUL  CLT  and  FCLT  must  always  be  the  variance 
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Var(  y  I ),  which  is  necessarily  finite  for  those  limits. 

Remark  (3.1)  We  conjecture  that  the  N&S  conditions  for  the  partial  sums  S„  in  the  WLLN  and 
CLT  are  also  N&S  conditions  for  the  random  sums  Ssu)  and  the  cumulative  process  C(t).  This 
would  follow  if  the  WLLN  and  the  CLT  in  (2.5)  for  were  equivalent  to  the  FWLLN  in  (2.4) 
and  the  FCLT  in  (2.6),  respectively,  for  Ssu)^  which  we  also  conjecture  to  be  true. 

(3.2)  The  partial  necessity  result  in  part(c)  of  Theorem  1  is  easily  explained  as  follows:  For 
any  distribution  of  we  can  construct  a  regenerative  process  such  that  N(t)  =  [/], 
C([f])  =  Snu)  =  5(,|,  and 

C(t)  =  (!-/+  [t])Clt]  +  {t-[t])C{[t]  +  1)  ,  r>0.  (3.1) 

where  [  t  j  is  the  greatest  integer  less  than  or  equal  to  /;  in  particular,  just  let 

X(t)  =  .  /  >  0  .  (3.2) 

Hence,  for  the  WLLN  and  CLT,  the  cumulative  process  C(r)  and  the  random  sum  are 
equivalent  to  the  partial  sum  5[,|.  For  such  examples,  the  N&S  condition  for  the  partial  sums 
also  obviously  is  the  N&S  condition  for  and  C(r). 

(3.3)  The  SLLN  result  is  due  to  Smith  (1955);  see  Theorem  3  1  on  p.  136  of  Asmussen 
(1987).  The  standard  sufficient  condition  for  the  CLT  is  Var  Yiif)  <  <»  and  Var  Xj  <  »,  see 
Theorem  3.2  on  p.  136  of  Asmussen  (1987),  which  is  stronger  than  our  sufficient  condition, 
because  we  do  not  require  that  Var  x  i  <  «;  see  Proposition  2  below.  To  see  that  we  could  have 
VarXi  =  oo,  suppose  that  T/{/)  =  x,  +  C/,  where  Var  (/,  <  <».  Then  Yi(fc)  =  (/,  and 
Var  F,(/c)  <  oo  fora  =  1. 

(3.4)  The  sufficient  condition  for  the  WLLN  is  weaker  than  £|T]|  <  oo.  Since 

£|  Fi  I  =  P{\Y\  \  >  t)dt,  £|  T]  I  <  oo  implies  that  /P(|  Kj  |  >  f)  — »  0  as  f  ->  oo  For 

example,  if  Y^  has  a  symmetric  distribution  with  P(Yx  >  t)  =  A/t(Iogt)''  for  p  ^  1,  then  the 
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conditions  hold  with  £|  K,  |  sz  oo. 

(3.5)  To  see  that  the  established  conditions  on  Wi(fc)  are  needed  in  addition  to  the 
conditions  on  ^i,  consider  the  following  example.  Let  P{X\  =  2)  =  1  and  let  fit)  =  Z*  for 
2^  -  2  <  r  <  2^  -  1  and  fit)  =  -  Z*  for  2*  -  1  <  r  <  2k,  where  { Z*  :  /t  >  1 }  is  a  sequence 
of  i.i.d.  random  variables.  Then  PiYi  =  0)  =  P(5„  =  0  for  all  n)  =  1,  while 
Ci2k  -  \)  =  Zk  =  Wk.  Then  apply  Propositions  5-8  below. 

4.  Supporting  Propositions 

In  this  section  we  present  several  basic  propositions  that  help  establish  and  interpret 
Theorem  1.  The  first  four  propositions  show  how  the  conditions  on 
^\(fc)  *  Y\if-ot.)  s  Yiif)  -  at  I  in  Table  1  relate  to  conditions  on  Kj(/),Ti  and  a. 
Proposition  1.  //  £|  Kj  (/£.)(<  <»  holds  for  some  a,  then  it  holds  for  all  a,  in  which  case 
E  Yiifc)  =  £y,(/)  -  a£x,. 

Proof.  Note  that 

E\y\{f)  -a,t,|  =  £|r,(/)  -a^x-Ka:  -a,)x,l 

^  E\Yxif)  -  a2X|  +  Itti  -  aj  |£Xi 

and  recall  that  £x  i  <  oo.  ■ 

Proposition  2.  A  sufficient  (but  not  necessary)  condition  for  £|  Ki(/c)|'’  <  oo  for  p  >  I  is  to 
have  E\  Ki  (/)!'’  <  oo  and  £xf  <  oo. 

Proof.  By  Minkowski's  inequality,  p.  47  of  Chung  (1974), 

(£|r,(/,)|'’)'^''  =  (£|K,(/)  - 

S  (£|1',  (/)!'’)>''’ -t-  a(£xf)‘^'’  . 

To  see  that  the  condition  is  not  necessary,  suppose  that  (/)  =  ax i .,  ■ 

Proposition  3.  .  i  WLLN  holds  for  the  partial  sums  of  P,  (/c )  for  one  a  if  and  only  if  it  does  for 
all  OL  Moreover,  the  limit  is  y  for  Y^if  -  aj ).  if  and  only  if  it  is  y  -  (a2  -  a|  )X.“'  for 
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y,U  -  a,). 

Proof.  Suppose  that  the  WLLN  holds  for  the  partial  sums  of  K,(/  -  a, ).  Since  £t,  <  «,  the 
T,  obey  a  WLLN  too.  By  Theorem  4,4  of  Billingsley  (1968), 

Z  (!',(/)  -  ait,)  .  =>  (y.  as  n  ^  , 

1=1  /=i 

so  that  by  the  continuous  mapping  theorem  with  the  function  h(x,  y)  =  ^  -  (a2  -  ai  )>.  we 
obtain 

n 

Z  ~  “21,)  =5*  Y  -  (ai  -  tt]  )X"'  as  n  oo  .  ■ 

1  =  1 

As  a  corollary  to  Proposition  3,  we  obtain  the  following  property  of  the  N&S  conditions  in 
the  WLLN  for  the  partial  sums.  A  direct  proof  is  also  possible. 

Proposition  4.  (a)  If 

tP(\y\(fc)\  >t)  -^0  as  t^oo 
for  some  a,  then  it  holds  for  all  a 
(b)If 

^{y  \{f)  ~aiti  ;  |Ki(/)  —  a|Ti|<r]  y  as  t  oo  , 

then 

^[l'i(/)  -  a2ti  ;  iy'i(/)  -  a2X,|  Sr]  Y  -  (“2  -  a,)X,~*  as  t  oo  . 

Proof.  We  use  Proposition  3  plus  the  fact  that  the  conditions  in  Proposition  4  are  known  to  be 
N&S  for  the  WLLN  for  partial  sums  of  i.i.d.  random  variables;  see  p.  235  of  Feller  (1971).  ■ 

The  conditions  on  Wi(/,.)  in  Table  1  can  be  established,  explained  and  applied  via  the 
following  propositions. 

Proposition  5.  Let  {Z,  :  /  >  1 }  be  a  sequence  of  i.i.d.  random  variables  and  let  <t)(r)  be  a 


deterministic  function  oft  such  that  ^(t)  oo  as  t  oo.  Then 

(t)(/2)”'  max  { [Z,  I }  =i>  0  as  /I  ->  oo 

1  <  (  <  n 


if  and  only  if 


t  P{_\2, ^  \  ><|)(/))  — >  0  as  /  — >  oo  . 


Proof.  Note  that 


(4.1) 


(4.2) 


P(  max  {\Z,\]  >  e<|)(n))  =  1  -  f (e^C/j))"  . 

1  <  /  <  n 

where  F(x)  =  P(|Zi  |  <  jt),  so  that  (4.1)  holds  if  and  only  if,  for  each  £  >  0,  f(e<t»(/i))"  — >  1 
or.  equivalently, 

n  log(l  -  f‘^(e<t)(/i))  0  as  n  oo  ,  (4.3) 

where  F‘^(x)  =  1  -  F(x).  Since  f‘^(e<|)(/i))  0as«  oo,  we  can  apply  Taylor’s  theorem  to 
obtain 

log(l  -  F^iE^in)))  =  -  f''(e(j>(n))  +  C>(F‘’(e(|)(«))‘)  , 

Thus,  (4.3)  holds  if  and  only  if /iF‘^(£<|i(n))  -^Oas/i  oo.  ■ 

The  following  is  a  consequence  of  the  Borel-Cantelli  lemma;  see  Theorems  4.2.2  and  4.2.4  of 
Chung  (1974). 

Proposition  6.  Let  { Z,  :  /  ^  \)  be  a  sequence  ofU.d.  random  variables  and  let  a„  be  constants 
such  that  a„  oe  as  n  -*  oo.  Then  the  following  are  equivalent: 

(i)  Z„/a„  -*  0  w.p.I  asn  -*  oo 

(ii)  max  ('  )/a„  -*  0  w.p.I  as  n  oo 

l  <,kin 

(Hi)  £  P(\2\  \  >  a „)<  oo. 

t%  *  I 


If  these  properties  do  not  hold,  then  lim  (Z„/a„}  =  oo  w.p.I. 
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As  a  consequence  of  Proposition  6,  ve  have 

Proposition  7.  In  the  netting  of  Proposition  6.  if  a  „  =  n,  then  a  further  equivalent  property  is 

E\Z\  \  <  oo. 

Proof.  As  in  Theorem  3.2. 1  of  Chung  { 1974), 


X  P(1Z,1  >n)  <£1Z,1  <  I  +  I  P(1Z,|  >n)  . 

rt  =  1  n  =  I 


Proposition  8.  Let  c  be  a  constant.  0  <  c  <  1.  For  any  positive  random  variable  Z, 


P{Z‘  >  nLin)  <  P 


Z* 


L^Z 


>  n 


<  P{Z~  >  cnLin) 


for  all  sufficiently  large  n.  so  that 


J  P{Z  >  yjn  Lin  )  <  « 

n  » t 


if  and  only  if 


Z  P 

1 


L2Z 


>  n 


<  00 


Proof.  IffZ'/LiZ)  >  «,  thenZ*  >  n,  sothat2LZ  >  Ln,L2Z  >  £2'*  “  £2  and 

Z^  >  nL2Z  >  n{L2n  -  L2)  > 

for  all  suitably  large  n.  Next,  note  that  g(x)  =  x'/Lix  is  increasing  for  all  x  large.  Hence,  if 
Z^  >  nZ.2'‘«  then 


g(Z)  =  — —  >  g(SnL^)  = 


nL->n 


nLin 


L^Z 


nL->n 

>  — ^  =  n 


L-yfnLTn  L^(Ln  L-^n) 


for  all  suitably  large  n.  Hence,  we  have  the  desired  inequalities. 


We  now  show  that  the  second  remainder  term  /?2(0  in  (1.7)  is  asymptotically  negligible  in 
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the  setting  of  the  WLLN  and  CLT,  because  £t  j  <  «.  The  asymptotic  negligibility  follows  from 
convergence  without  further  normalization,  for  which  we  must  distinguish  between  the  lattice  and 

nonlattice  cases.  Recall  that  the  distribution  of  t  is  lattice  if  ^  P(x  =  k5)  =  1  for  some  5, 

h=0 

with  the  largest  such  6  being  the  period;  otherwise  it  is  nonlattice. 

Proposition  9.  (a)  If  x  has  a  nonlattice  distribution,  then  R2(t)  R2{o°)  as  t  oo,  where 

R2{t)  is  in  (1.7)  and  R 2(00)  is  a  proper  random  variable  with  distribution  function 

P(/?2(oo)  <  jc)  =  X  J^“p(R2(/)  <  x  ;  X]  >  t)dt  .  (4.4) 

(b)  If  X  has  a  lattice  distribution  with  period  5.  then  /?2(it5  +  y)  Ry(°o)  as  k  00  for 
each  V,  0  <  V  <  5.  and  sup  { |/?2(X5  +  y)| }  ^  /?'(<»)  as  k  eo,  where  Ry(.oo)  and  R'(oo) 

OSy  <  8  ^ 

are  all  proper  random  variables. 

Proof,  (a)  We  apply  the  key  ienewal  theorem;  see  p.  120  of  Asmussen  (1987).  For  this  purpose, 
let  g  be  a  continuous  nonnegative  real- valued  function  of  a  real  variable  with  g{t)  <  M  for  all  t. 
Note  that  £[g(P2(0)]  satisfies  a  renewal  equation,  i.e., 

E[g(,R2itm  =  £U(/?2(f))l(t,  >,»]  +  Jj£Ig(/f2(^-  M))]/’(Xi  6  du)  ,  (4.5) 

Where  1 .4  is  the  indicator  function  of  the  set  A.  Letz(r)  *  £[g(/?2(0)l  (t,  >  »i  ]•  We  now  show 
that  z  is  directly  Riemann  integrable,  so  that  we  can  apply  the  key  renewal  theorem.  For  this 
purpose,  we  apply  Proposition  4.  l(ii)  on  p.  119  of  Asmussen  (1987).  Since  z(t)^M,  the 
function  z  is  bounded.  Moreover,  b(t)  m  giRziO)^  ir,  >t]  ^  ^  function  of  r  has  a  single 
discontinuity  at  x  j  for  each  sample  path.  Hence,  the  function  b  is  continuous  w.p.  1  at  all  points  t 
for  which  P(Xi  =  r)  =  0.  By  the  bounded  convergence  theorem,  z{t)  *  Eb{t)  is  thus 
continuous  at  all  t  for  which  P(Xi  =  t)  =  0.  Since  P(Xi  =  /)  =  0  for  all  but  countably  many 
r,  z  is  continuous  almost  everywhere  with  respect  to  Lebesgue  measure.  Next,  let 
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Zhit)  =  sup{j(v)  ■.  kfi  <  y  <  (k  +  l)/i}  for  /t/i  <  /  <  (/t  +  l)/i  (4.6) 

as  on  p.  1 18  of  Asmussen  (1987).  Since  ;(/)<  P(ti  >  t), 

f  ZhiOdt  <  ^  P(T,  >  h)  <  oo 

^  *=o 

by  Proposition  7  above.  Hence,  we  have  shown  that  z  is  indeed  directly  Riemann  integrable.  The 

key  renewal  theorem  thus  implies  that  £g(/?2(0)  z{u)du  as  r  However,  all 

bounded  continuous  nonnegative  functions  g  determine  convergence,  so  indeed  Ri^t)  /? 2(<») 
as  f  — »  oo.  Moreover,  we  can  characterize  the  limiting  distribution  using  these  functions  g,  so 
that  (4.4)  holds. 


(b)  The  argument  is  essentially  the  same;  we  apply  discrete-time  renewal  theory  along 
subsequences;  see  pages  8  and  121  of  Asmussen  ( 1987).  Note  that  we  have  the  renewal  equations 

k 

P(R2{kb  +  y)  >  jc)  =  PiRzikS  +  y)  >  x ,  Xy  >  k)  +  PiRziik  -  j)S  +  y)PiXi  =  j) 

and 

P(  sup  WRzikb  +  y)\)  >  x)  =  Pi  sup  { |/?2(A:6  +  v)| }  >  x  ,  Ti  >  t) 

0S.v<8  Oiy  <6 

+  '^  Pi  sup  {iRziik  ~  j)5  +  y)\)  >  x)PiXi  =  j)  , 

y.O  0Sy<8 

where 


PiRikb  +  y)  >  x,Xy  >  k)<PiXy  >  k) 
and 

Pi  sup  { |/?(il:6  +  v)| )  >  X  ,  Xy  >  k)  <  P(Xy  >  k) 

0  S  y  <  8 

with  2^  PiXy  >  k)  <  oo  since  £xi  <  oo.  ■ 

*-o 
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Under  our  i.i.d.  conditions,  functional  versions  of  the  WLLN  and  CLT  for  the  partial  sums  are 
equivalent  to  the  ordinary  versions.  For  this  purpose,  we  can  apply  Theorem  2.7  of  Skorohod 
(1957),  which  we  now  quote. 

Proposition  10.  (Skorohod  (1957))  Let  { ;  i  >  1 }  be  i.i.d.  for  each  n  and  let 

[n,\ 

Z„(0  =  X  t  ^  0-  77ien 
1  =  1 

Zf,{t)  Z(t)  as  n  — >  oo  in  DIO,  oo)  , 

where  Z  has  stationary  independent  increments,  if  and  only  ifZ„{t)  =i>  Z(t)  as  n  — >  «  m  R  for 
each  t. 

5.  A  Joint  Central  Limit  Theorem 

In  this  section  we  consider  a  joint  CLT  for  the  cumulative  process  C  and  the  counting  process 
N.  We  obtain  a  necessity  result  in  the  case  £|  |  <  »,  which  holds  when  /  is  nonnegative; 

necessity  in  the  general  case  remains  open. 

Remark  (5.1)  Even  without  the  i.i.d.  conditions,  limits  for  the  counting  process  N  alone  hold  if 
and  only  if  the  corresponding  limit  holds  for  the  associated  partial  sums;  see  §7  of  Whitt  (1980), 
Theorems  3  and  6  of  Glynn  and  Whitt  (1988a)  and  Theorem  1  of  Glynn  and  Whitt  {1988b).  For 
example,  as  a  consequence,  N  satisfies  a  CLT  if  and  only  if  Ex\  <  eo.  For  this  we  apply 
Theorem  6  of  Glynn  and  Whitt  (1988)  and  Theorem  4,  p.  181,  of  Gnedenko  and  Kolmogorov 
(1968).  ■ 

We  Stan  with  a  necessary  condition  for  the  WLLN  when  /is  nonnegative. 

Theorem  2.  Suppose  that  f  is  nonnegaiive.  Then  a  N&S  condition  for  the  WLLNs  for  S„,  S^nn 
and  C(t)  is  E\Y\  \  <  oo. 

Proof.  If/ is  nonnegative,  then  Y\  =  Wj,  so  that  £(  Fj  j  <  oo  is  sufficient  for  the  three  SLLNs 
by  Theorem  I.  If  /  is  nonnegative,  then  the  N&S  condition  for  the  WLLN  for  S„  in  Table  1  is 
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equivalent  to  £|  K,  |  <  «.  By  Proposition  9.  the  WLLNs  for  Sfj(,)  and  C(t)  are  equivalent. 
Hence,  suppose  that  C(r)  obeys  a  WLLN;  i.e., 

r'  =i»  a  as  r  oo  .  (5.1) 

On  the  other  hand,  suppose  that  £|  I'l  1  =  <».  Since  we  have  /  >  0,  we  can  apply  the  SLLN  to 
conclude  that 

Z  ^i(/)  °°  w.p.  1  as  n  oo  (5.2) 

(  =  1 

(see  Exercise  1  on  p.  130,  of  Chung  (1974)),  from  which  we  can  deduce  from  the  SLLN  proof  in 
Theorem  1  that 

r*  |J/(X(i))4/s  -*  oo  w.p.  1  as  r  -» oo  .  (5.3) 

(Recall  that  W'l  =  I'l  when  /  >  0.)  Hence,  (5.1)  cannot  hold  and  we  must  have 

£|K,(/)|<oo.  ■ 

Remark  5.2  An  alternative  approach  to  Theorem  5.2  (pointed  out  by  A.  Pukholskii)  is  to  note 
that  the  WLLN  for  C(t)  implies  the  FWLLN  because  the  sample  paths  are  nondecreasing.  This 
argument  also  depends  critically  on/ being  nonnegative. 

We  now  state  N&S  conditions  for  the  joint  CLT. 

Theorems.  If£[Ti]  <  oo  and  £iyi  (/)^]  <  oo,  then  (C(t),N(t))  obeys  a  joint  CLT,  i.e., 

/"•^(C(r)  -  OLt ,  Af(/)  -  \t)  =>  N{0, 1)  as  t  eo  in  (5.4) 

where  X  =  l/£xi,  a  =  XEYi^f)  and  /V(0, 1)  is  a  bivariate  normal  distribution  with  covariance 
matrix  elements  Ill  =  ^£[Li(/c)*],l22  =  X' Var  x j  and  1 12  =  X‘£[Li(/c)x]. 

(b)  If  £|  Ki  I  <00,  then  the  joint  CLT  (5.4)  implies  that  £[  (/)^  ]  <  00  and  £[Xi  ]  <  00. 

Proof,  (a)  the  sufficiency  is  a  minor  extension  of  Theorem  1  of  Glynn  and  Whitt  (1987).  First, 
by  the  multivariate  version  of  Donsker’s  theorem,  the  conditions  imply  a  joint  FCLT  for  the 
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partial  sums  of  (K,(/),t,),  i.e., 

,  _  [('“1  In'l 

-  E[Yaf))  ,  'Lee,  -  EXi)  =>  (fl,(7).  fl:(r))  (5.5) 

.1  =  1  1  =  1 

in  D(O.oo)  xD[0,oo),  where  (81,82)  is  Brownian  motion.  Then  by  continuous  mapping 
arguments  we  obtain  a  joint  FCLT  for  5^^,)  and  N(t).  i.e.. 

[Wn/i 

I  (Y,(f)  -  EY,(f))  .  N(nt)  -  Xnt  =>  (8^(t)  ,82(1))  (5.6) 

.  '  =  i 

as  «  — >  00  in  D[0,  <»)  x  D[0.  <»).  The  Joint  FCLT  (5.6)  is  obtained  in  Glynn  and  Whitt  (1987). 
It  in  turn  implies  an  ordinary  CLT  by  applying  the  continuous  mapping  theorem  with  the 
projection.  This  ordinary  CLT  is 

r‘^(  X  (>'.(/)  -  EYiif))  .  N(t)  -  kt)  =>  N(0, 1)  (5.7) 

i«i 

for  the  stated  Z.  The  result  (5.7)  then  is  equivalent  to  (5.4)  because  the  remainder  terms  are 
asymptotically  negligible;  i.e.,  by  Proposition  9,  r"*'^/?2(r)  ^  0  as  /  -»  00.  Hence,  (5.4) 
follows  from  (5.7)  and  the  converging-together  theorem,  Theorem  4. 1  of  Billingsley  (1968). 

(b)  Turning  to  the  necessity,  we  reverse  the  argument  and  note  that  (5.4)  implies  (5.7), 
because  the  difference  is  asymptotically  negligible,  by  virtue  of  Proposition  9.  Now  we  apply 
Theorem  7(a)  of  Glynn  and  Whitt  (1988a),  for  which  we  use  the  assumption  that  £|  Ki  |  <  «>.  It 
implies  that 

.-[mo  ix»i 

X  -  I  yk(/c)  =>  Oast -^00,  (5.8) 

*-i  *-i 

which  with  the  converging-together  theorem.  Theorem  4.1  of  Billingsley  (1968),  implies  that  the 
partial  sums  of  K,  (/f)  obey  a  CLT.  As  before.  Theorem  4  on  p.  181  of  Gnedenko  and 
Kolmogorov  ( 1968)  then  implies  that  E[  T|  (/<. )‘ )  <  on.  By  Remark  5. 1,  the  CLT  for  N  implies 
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that  £[xil  <  oo. 


6.  Proof  of  Theorem  1 


(a)  SLLN 


The  condition  £|  I'l  |  <  oo  is  well  known  to  be  N&S  for  the  partial  sums  S„  in  ( 1.5)  to  obey 
the  SLLN;  see  p.  126  of  Chung  (1974).  Since 


N(t)  ^N(i) 


t  NU)  t 


(1.8)  implies  that  the  same  condition  is  N&S  for  the  random  suns  Ssn)-  Since 


|C(r)  -  ^  l^i(0!  +  |/?2(/)|  <  |/?,(t)|  + 


(6.1) 


(6.2) 


by  (1.4)  and  (1.7),  and 


A((r)+1  ^/v(o+i 


t  (V(o+i 


(6.3) 


Proposition  7  implies  that  £|  T]  |  <  oo  and  EW^  <  oo  are  sufficient  for  the  cumulative  process 
C(r)  to  obey  the  SLLN. 

Now  we  establish  the  necessity  for  C(r).  Suppose  that  f'  C(r)  y  w.p.l  as  r  y,  where 
0  <  y  <  oo.  First,  since 


Cdt)  ^  R^{Tk)  ^  £i  _L 
Tk  Tt  k  7* 


(6.4) 


and  (1.8)  is  equivalent  to  )t~'7*  -»  X"*  w.p.l  as  it  oo,  we  see  that  then  n~^S„  — »  X"'y 
w.p.  1  as  n  -»  oo,  which  implies  that  £|  Ti  |  <  oo  and  y  =  X£[  Ti .  Next  suppose  that  EW^  =  oo. 
Then,  by  Proposition  7, 


lim  n~'W„  >0  w.p.  1  , 


(6.5) 


(indeed,  even  lim  =  oo  w.p.l)  so  that  there  is  a  sequence  of  random  times  { ;  it  ^  1 } 
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such  that  T„^  <^1,  <  T„^^^  and 

iim  Pr‘  fiXis))ds  >  0  ,  (6.6) 

so  that 

iui  Pl'  fms)ds  >  lim  77'  f  f(X{s))ds  =  EY^  ;  (6,7) 

k  ^  oo  0  Ar— »oe  0 

i.e.,  then  /“'C(f)  fails  to  converge  w.p.l  as  r  — »  <».  so  that  assuming  £W,  =  <»  leads  to  a 
contradiction.  Hence,  the  SLLN  for  C{t)  implies  that  £W|  <  oo. 


(b)  LIL 

The  condition  E[Y\{fc)\  <  oo  is  well  known  to  be  N&S  for  the  partial  sums  of  Y,(fc)  to 
obey  the  LBL  with  P  =  Var  K]  (/c);  see  Strassen  (1966),  Heyde  (1968)  and  pp.  297-8  of  Stout 
(1974).  Since 


^NU) 


Snu)  I  Li  t 

yfJTL^  [mOL.NO) 


(6.8) 


and  (1.8)  implies  that 


t  Lit 

NiDLiNit) 


w.p.  1  as  f  oo  , 


(6.9) 


the  LIL  holds  for  the  partial  sums  if  and  only  if  it  does  for  the  random  sums;  for  Ssu)< 
P  =  X  Var  T|  (/c  )•  By  (6.2),  we  establish  sufficiency  for  the  cumulative  process  if  we  show  that 

- —  — »  0  w.p.l  as  f  — ♦  oo  .  (6.10) 

yjtLi  t 


By  (6.9),  it  suffices  to  show  that 


W„{fc) 

SnL^ 


-♦  0  w.p.  1.  as  n  oo  , 


(6.11) 
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To  establish  (6.11),  we  use  Propositions  6-8.  Proposition  7  with  the  condition  on  V^i(/c) 
implies  that  2  -»  Ow.p.lasn  ».  Propositions  6-8  then  imply  (6.1 1). 


Turmng  to  the  necessity,  from  the  LIL  for  C(t),  we  obtain  the  LIL  for  the  partial  sums 
themselves  by  considering  the  subsequence  of  limes  {  7(n)  ;  n  >  1 }.  By  the  known  converse  of 
the  LIL  for  the  partial  sums,  we  deduce  that  we  must  have  £[Lj (/,.)]  <  Finally,  if  the 
moment  condition  on  Wj  (/^ )  is  violated,  then,  by  Proposition  7, 


oo 

I 


Wn(fc) 

-  >  n 


oo  . 


(6.12) 


By  Proposition  8,  (6.12)  implies  that 


I  P 


Wn(fc)  >  yfnTTTi 


oo  « 


(6.13) 


i.e.,  by  Borel-Cantelli, 


lim  —==  >0  w.p.  1. 
"  yjn  L2  n 


(6.14) 


As  in  the  necessity  for  the  SLLN  in  (6.6)  and  (6.7),  (6.i4)  implies  that  there  are  random  times  3* 
with  T„^  ^3*  <  +  ,  such  that 

^  j\c{X{s))ds  >  iiS  ,  ^  j^‘MX{s))ds  =  Var  !',(/,)  (6.15) 


(c)  FUL 

In  our  i.i.d.  setting,  the  sufficient  condition  for  the  LIL  implies  the  FLIL  for  the  partial  sums 
of  F,(/f);  see  Strassen  (1964).  Since  the  FLIL  implies  the  ordinary  LIL,  by  virtue  of  the 
continuous  mapping  applied  to  the  projection  at  time  1,  the  N&S  condition  for  the  LIL  for  the 
partial  sums  is  N&S  for  the  FLIL  for  the  partial  sums.  By  (1.8)  the  SLLN  holds  for  N{t).  As 
before,  the  SLLN  for  N(t)  is  equivalent  to  a  FSLLN  of  the  form 
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-  “4  X/  w.p.  1  in  Z)[0,  oo)  as  n  oo  .  (6.16) 

n 

Using  the  random  time  change  by  N(nt)/n  in  D[0,  oo),  which  is  a  continuous  map  (see  §17  of 
Billingsley  ( 1968)  or  Whitt  ( 1980)),  we  obtain 

N  (  ftt  V 

—^=  C'  w.p.  1  in  D{0,  oo)  as  «  -»  oo  ,  (6.17) 

ylnLTn 

where  C'  is  the  set  of  y  in  D[0.  oo)  such  that  >(r)  =  jr(Xr),  t  >  0,  for  x  in  C.  and  C  is  the  limit 
set  associated  with  the  partial  sums.  As  before,  the  FLIL  for  the  random  sums  implies  the 
ordinary  LIL,  which  we  saw  in  part  (b)  implies  the  LIL  for  the  partial  sums. 


To  establish  the  FLIL  for  the  cumulative  process  C(r),  we  apply  the  moment  condition  on 
^i(/c)  With  u_  noment  condition.  Propositions  6-8  imply  that 

(nLon)"^'  max  { ) )  -♦  0  w.p.  1  as  n oo  .  (6.18) 

1  S  it  S  n 


Then  (6.16)  and  (6.18)  imply  that 

max  {Wt(/,)}  -*  0  w.p.  1  as  n  — »  oo  .  (6.19) 

\ikiS(n)  +  \ 

Given  the  FLIL  for  the  random  sums,  (6.2)  and  (6. 19)  imply  the  FLIL  for  C(  f ). 


Turning  to  the  necessity  for  the  cumulative  process,  we  obtain  the  FLIL  for  the  partial  sums 
by  considering  the  times  T{nt)/n.  (The  first  remainder  term  is  obviously  asymptotically 
negligible.)  Hence,  E[  Fj  (/,.)]  <  <»  is  a  necessary  condition.  Since 


nS{nt)) 

n 


-*  t  in  D(0,  oo)  w.p.  1  as  n  oo  , 


(6.20) 


we  have  the  joint  limit 

(nLinV'^' fcms))ds  ,  \  f,{X{s))ds)  ^  (C,  C)  w.p.l  (6.21) 

0  0 

as  n  — »  oo  in  D[0,  oo)  x  D[0,  oo).  Hence,  the  normalized  difference  converges  to  0,  i.e.. 
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(/iLifi)  I  fc{X{s))ds  0  in  D[0,  oo)  w.p.  1  as  «  — ^  »  (6.22) 

or,  equivalently,  (6.19)  holds,  which  in  turn  is  equivalent  to  (6.18)  given  (6.16).  By 
Propositions  6-8,  (6. 18)  implies  the  moment  condition  on  W]  ( /^ ). 

(d)  WLLN 

The  stated  conditions  for  the  partial  sums  in  Table  1  are  known  to  be  N&S;  see  Theorem  1  on 
p.  235  of  Feller  (1971).  By  Proposition  10,  the  WLLN  implies  the  FWLLN  for  the  partial  sums 
in  this  setting.  Alternatively,  it  is  not  difficult  to  show  that  the  conditions  are  N&S  for  the 
FWLLN  directly.  Since  the  FWLLN  implies  the  WLLN,  we  only  need  demonstrate  sufficiency. 
Instead  of  (7.4)  and  (7.5)  on  p.  234,  235  of  Feller  (1971),  we  write 

P(  sup  |S(„,i  -  im' I  >  nx)  1  P(  max  I  Si  -  km'\  >  nx) 

OSrSl  ISiSn 

+  P(Sic  *  S'lc  for  some  k  ,  \  ^  k<  n) 

EiX?)  ,  . 

<  - -  +nP(\X,\  >5„) 

nx' 

using  Kolmogorov's  inequality  in  the  second  step.  The  rest  of  the  argument  is  the  same. 

The  FWLLN  for  the  partial  sums  in  turn  implies  the  FWLLN  for  the  random  sums,  by  virtue 
of  a  random-time  change  argument  (as  in  §17  of  Billingsley  (1968)  or  §3  of  Whitt  (1980)).  The 
FWLLN  for  the  random  sums  implies  the  ordinary  WLLN.  By  applying  the  continuous 
projection  map  at  r  =  1.  (Alternatively,  the  WLLN  for  the  random  sums  follows  directly  from 
the  WLLN  for  the  partial  sums;  see  Theorem  10.1  on  p.  148  of  Revesz  (1968).) 

Finally,  the  WLLN  for  the  random  sums  is  equivalent  to  the  WLLN  for  the  cumulative 
processes  by  (6.2)  and  Proposition 9.  In  particular,  since  |/?i(f)|  ^  Wq,  0  as 

t  00-,  Proposition  9  implies  that  RiiO/i  =>  0. 


(e)  FWLLN 
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The  sufficiency  for  the  partial  sums  and  random  sums  follows  from  the  argument  in  part  (d). 
Given  the  FWLLN  for  the  random  sums,  the  FWLLN  for  the  cumulative  process  follows  from  the 
extra  condition  on  VV,(/j,  Proposition  5  with  Z,  =  and  0(0  =  t,  and  (6  2).  In 

particular,  the  exua  condition  on  and  Proposition  5  imply  that 

n"'  max  Wtl/  )  0  as  u  — >  «  (6.24) 

1  <  *  <rt 

or,  equivalently, 

W'(„,|(/f)  =>  0  as  «  oo  in  D(0,  «)  .  (6.25) 

Then,  by  a  random  time  change  argument, 

^  0  as  n  oo  in  D[0,  «)  (6.26) 

or,  equivalently, 

«■’  max  { W'*(/f)}  =s>  0  as  n oo  ,  (6.27) 

but,  by  (6.2), 

sup  -  «-‘C(fi/)|}  +  «■'  max  {«'*(/,)}.  (6.28) 

OS»S  I  I  S*S/V(n)  +  1 

We  now  turn  to  necessity.  Given  the  FWLLN  for  the  random  sums,  we  obtain  the  FWLLN 
for  the  partial  sums  by  applying  the  converse  to  continuity  for  composition,  i.e..  Theorem  3.3  of 
Whitt  (1980),  A  direct  application  yields  the  FWLLN  for  the  partial  sums  in  D((0,  oo)),  with  an 
open  interval  at  the  left,  but  this  implies  convergence  in  D[a,  b]  for  all  a  and  b  with 
0  <  a  <  b  <  oo,  which  in  turn  implies  convergence  in  D[0,  «)  for  the  partial  sums  of  i.i.d. 
random  variables.  We  have  already  seen  that  the  FWLLN  for  the  partial  sums  implies  the 
condition  on 

Turning  to  necessity  he  cumulative  process,  first  we  apply  a  random  time  change 
argument  to  get  the  FWLLN  for  the  partial  sums,  which  in  turn  implies  the  condition  on  Fi  (/<■). 
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In  particular,  n"'  T(^nt)  — »  as  n  — »  oq  in  D(0,  «).  so  that 

I  ,  (  Tint)  _  I 

n“*5[n/]  =  n'  fc{X{s))ds  -  n  /?j{nr)  =>  0  as  «  oo  in  D[0,  oo)  .  (6.29) 

Finally,  to  establish  the  condition  on  VV|(/c.),  we  note  that  T{N{n[)  — >  /  as  «  — ^  »  in 
D[0,  oo),  so  that 

,  r  nr  r  T(S(ni)) 

n  (I  f.(X{s))ds  ,  ]  /f(X(s))tis)  ^  (0,  0)  as  n  oo  (6.30) 

•'o  "^0 

inD[0  1  OO  )  X  D[0,  OO  )  and 

,  r  nl  c  T(S(nt) 

n  *  [  /c(^('^))^'^  “  Jq  /f  (X(s))<is]  =s*  0  as  n  — ^  oo  as  n  oo  in  D[0,  oo)(6.31) 

which  in  turn  implies  that 

n"*  max  Wi.{f^)£  sup  (n"'|f  /c(X(s))</5| }  =5>  0  as  « oo  (6.32) 

OikiN(nt)  OS/ St  ^T(N(m)) 

and  then,  reversing  the  argument  from  (6.24)  to  (6.27),  we  obtain  (6.24),  which  by  Proposition  5 
implies  the  condition  on  Wj  (/^ ). 

(0  CLT 

By  p.  181  of  Gnedenko  and  Kolmogorov  (1968),  E[Y\{fc)]  <  <»  and  E[Y\{fc)]  =  0  is 
N&S  for  the  CLT  for  the  partial  sums.  Donsker’s  theorem  or  Proposition  10  implies  that  this 
condition  is  also  N&S  for  the  FCLT. 

Given  the  FCLT  for  partial  sums,  we  obtain  the  FCLT  for  random  sums  by  a  random  time 
change  argument  as  in  §17  of  Billingsley.  As  usual,  the  FCLT  for  the  random  sums  implies  the 
ordinary  CLT  for  random  sums  by  applying  the  continuous  mapping  theorem  with  the  projection 
at  /  =  1.  Just  as  in  part(d),  the  CLT  for  the  random  sums  is  equivalent  to  the  CLT  for  the 
cumulative  process,  because  /?i(r)/V7=^0  and  Ri{t)/'Tt  =>  0  as  t -*  oo,  the  last  by 
Proposition  9. 
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(g)  FCLT 

Tlie  necessity  and  sufficiency  for  the  partial  sums  and  the  sufficiency  for  the  random  sums 
follows  from  the  argument  in  part  (0.  The  rest  of  the  argument  is  just  as  in  part  (e). 

Acknowledgment.  We  thank  Karl  Sigman  for  helpful  discussions. 
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limit 

theorem 

partial 

sums 

cumulative  process 

C(t)  2  j^f{X(s))ds 

SLLN 

£|F,|  <  oo 

+  EW 1  <  oo 

LIL 

E[y\(fc)']  <oo 

+  £[W,(/,)/L;W,(/,)]  <  oo 

FLIL 

E[Yi(fS‘]  <  « 

+  £[W,(/,)/£,W,{/,)]  <  oo 

WLLN 

tP{\Y^  \  >0^0 
and 

£[Fi  ;|  Ki  1  <  fl  -4  a  as  /  oo 

*7 

FWLLN 

rP(|F,|  >  0  ^  0 
and 

£[Ki;  |F(|  2/]  — ^  ft  as  /  oo 

+  /  P{W  >  t)  — >0asr  — ^oo 

CLT 

ElYiif,)-]  <oc 

7 

FCLT 

ElYii/c)']  <  oo 

+  r^/*(Wj(/c)  >  t)  — >0asr— >oo 

Table  1.  Necessary  and  sufficient  conditions  for  the  processes  to  obey  the  indicated  limit 
theorem.  For  the  established  cumulative  process  results,  the  condition  is  the  stated 
one  plus  the  condition  for  the  partial  sums  at  the  left. 
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Abstract 

Necessary  and  suffldenc  coodidons  are  established  for  cumulative  processes  (assodaied  with 
regeneradve  processes)  to  obey  several  classical  limit  theorems;  e.g..  a  strong  law  of  large 
numbers,  a  law  of  the  iterated  logarithm  and  a  functional  central  limit  theorem.  The  key  random 
variables  ate  the  integral  of  the  regenerative  process  over  one  cycle  and  the  supremum  of  the 
absolute  value  of  this  integral  over  all  possible  initial  segments  of  a  cycle.  The  tail  behavior  of 
the  distribution  of  the  second  random  variable  determines  whether  the  cumulative  process  obeys 
the  same  limit  theorem  as  the  partial  sums  of  the  cycle  integrals.  Interesting  open  problems  are 
the  necessary  conditions  fbr  the  weak  law  of  large  numben  and  the  ordinary  central  limit 
theorem. 


